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A method and apparatus for visualizing a limited part of a 3D medical image-point-related 
data set, through basing a rendered image on an intermediate region between first and second 
clipping planes, and including spectroscopic viewing of such region 



BACKGROUND OF THE INVENTION 

The invention relates to a method as recited in the preamble of Claim 1. 
Various different technologies for in a broadly medical environment generating a digital 3D 
imaging data set have been in use, such as 3D-CT, 3D-MRI, 3D-Ultrasound, 3D-Rotational 
Angio, 3D rotational Xray, and others. The medical environment includes without limitation 
the use of such visualizing for therapy planning, exploration, teaching, or veterinary, 
generally as applied to various tissue types that are relevant for living matter. Prior art has 
proposed to apply a smgle clipping plane and to ignore all points lying on one side of the 
clipping plane. The present inventors have recognized further advantages that may be 
attained by applying two clipping planes and by subsequently considering only the region 
between the two planes. In particular, such 'thick-slab" metiiod would allow a feUcitous 
trade-off between on the one hand single-side clipping that keeps too much information for 
rendering, and on the other hand the usage of only information that would substantially be 
restricted to a single plane. The latter procedure would in fact provide only two-dimensional 
information. The inventors have further recognized that the viewing of the above thick slab 
would further allow the use of a stereoscopic viewing arrangement to provide a user person 
with even more pregnant information on the spatial details of the object xmder consideration. 

SUMMARY TO THE INVENTION 

In consequence, amongst other things, it is an object of the invention to retain 
information regarding an unaged region that is essentially three-dimensional, but to keep 
both information regarding a nearer region with respect to a first clipping plane and also 
information regarding a farther region with respect to a second clipping plane out of 
consideration, whilst retaining information of an intermediate region. Now therefore, 
according to one of its aspects the invention is characterized according to the characterizing 
part of Claim 1. 

In particular, the present invention has as a further object to implement two 
lines of view of the object that have a slightly diverging angle such as being in a range 
between 0° and 6*" for together providing a three-dimensional stereoscopic image of the 
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intemiediately retained region. Furthermore, the inventors have recognized as an additional 
generating technology for the im^e point related data set, the feasibility of tomosynthesis. 
By itself, the tomosynthesis technology focuses on getting only a single plane of image 
points sharp, but a subsequent parallel shifting or stepping of this plane will allow to cover a 
5 region that has the character of a "thick slab" as well. Moreover, the rotating of such single 
plane over the stereoscopic angle in the same range of values as recited above, will retain the 
original sharpness and resolution of the single image plane, so that through stepping the 
stereoscopic pair of planes the technology of tomosynthesis will also allow for applying the 
principles of the stereoscopic approach on a thick-slab-like region. 
10 The invention also relates to an apparatus arranged for implementing a method 

as claimed in Claim 1. Further advantageous aspects of the invention are recited in dependent 
Claims. 

BRIEF DESCRIPTION OF THE DRAWING 
1 5 These and further aspects and advantages of the invention will be discussed 

more in detail hereinafter with reference to the disclosure of preferred embodiments, and in 
particular with reference to the appended Figures that show: 
ffl Figure 1 , a general 3D-imaging device; 

Figures 2a-2d, the principle of the various 'thick-layer mode" functions; 
20 Figures 3a-3b, the building of a "tomosynthesis thick layer" through 

superposing a plurality of successive *thin layers"; 

Figures 4a-4b, the formation of a spatial spectroscopic image through this 
superposing of successive thin layers. 

25 GENERAL CONSIDERATIONS 

With respect to considering a clipping fimction in the context of the present 
invention, an overall volume will contain tissues of various categories that can cause 
associated varying imaging intensities. When projecting on a 2D imaging plane, a complex 
body will often exhibit an interfering or uninteresting nearer part, that may shield off 
30 mteresting details of an intermediate part, or a farther part that even without such shielding 
will provide a kind of structural background noise that is superposed on the information of 
the intermediate part. In this context, the direction of the main viewing axis may be in an 
arbitrary direction m space. Now, by having the present invention apply two clipping planes, 
and in particular, but not exclusively, where these are parallel, the rendering may be 
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restricted to the region between the two planes, which then can be viewed and inspected in a 
much more inquisitive and specific manner. The viewuig applies in particular to a thick slab. 
Such a thick layer or slab may be subjected to various operations, such as to slantmg or 
rotating around a substantially arbitrary axis, to shifting as a whole, to have its size or 
thickness amended, or to a largely arbitrary combination of these three modes, and possibly 
combined with still further elemental operations. The degree of parallelism among the two 
planes may be as good as the technical specifications of an apparatus would allow. On the 
other hand, a user may for various reasons wish to have the two clipping planes that are not 
completely parallel. One reason may be that either the object, or rather, interfering objects 
that are rich in contrast are leaving open a region of interest that is more or less wedge- 
shaped. The inventors would expect that most of the perceptual advantages of the invention 
would be attained for wedges with an angle that is less than 60°, whereas for an angle lying 
below 25** the perceptive view quality would be hardly inferior to that attained at 100% 
parallelism. 

In particular, the inventors have attained three-dimensional, real-time, 
dynamic manipulation of the image, and may therefore have the latter be dynamically 
controlled by the user, such as by feed-back through what is being shown effectively. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

The procedure of the present invention will generally start by applying a 
conventional two-dimensional imaging method such as an X-Ray scan on an intended object. 
Through repeating the 2D operation along various axes, such as by rotating the object over 
180*" around an axis that is generally perpendicular to the axis of the "line-of-sighf of the X- 
Rays, a 3D rotational X-Ray data set is obtained. The decreasing of the above rotation angle 
substantially below 180° will lower the eventual viewing quality. On the other hand, tiie 
increasing of the rotation angle substantially above 180° is generally not cost-efifective from 
the point lliat it should provide more information. 

The original paper in the field is L. A. Feldkamp et al, 'Tractical Cone-Beam 
algorithm", J. Opt. Soc. Am. AA^ol. 1, No. 6, June 1984, pages 612-619A. Reference is had 
also to a paper by M. Grass et al, "Three-Dimensional Reconstruction of High Contrast 
Objects Using C-Arm Image Intensifier Projection Data", Computerized Imaging and 
Graphics, Vol. 23 (1999), pages 31 1-321, inter alia including various resulting images. These 
algorithms or other high-powered computation algorithms will convert the data set into a 3D 
point-related data set. This 3D data set may immediately be used for rendering a 3D image of 
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the object on a display screen. This image may be subjected to vanous motions, such as 
shifting or rotating for getting the best possible view of the object that may allow to 
distinguish between arteries, bone, organs and tissues of various other kinds as displayed. 

The present inventors have however recognized that a great improvement in 
5 image quality will be attainable through clipping off such information that would relate to 
unwanted or uninteresting points in space, to thereby allow a great improvement in effective 
visualization conditions. For example, the viewing of tissue regions behmd certain bone 
structures is greatly enhanced when clipping the points associated to these bone structures out 
of consideration. Similar considerations apply to structures behind the region of interest. The 
10 same considerations apply to other diagnostic technologies, such as 3D-MRI, 3D-Ultrasound, 
3D-Rotational Angio, 3D-Rotational Xray, and others. 

By itself, the use of clipping has been recited by Huseyin Kemal, in "IVOR: 
Interactive and Intuitive Volume Rendering of 3D-Medical Data with 3D-Texturing Mapping 
Technique", httD://iregtl.iai.fzk.deA^RTRAIN/diplomarbeithtm . Here, three mutually 
1 5 perpendicular clipping planes are used, but the present inventors have experienced that 

Ihniting the unaged region to an intermediate region between first and second clipping planes 
is much more usefiil in the present operating context than the Kemal technique. 

Figure 1 illxistrates a general 3D-imaging device. Herein, item 20 is a medical 
object, such as a part of a human body. Item 22 is a medical imaging system, such as an X- 
20 Ray device that provides a pattern of relative transmittivity. For other imaging technologies 
such as magnetic resonance, ultrasound, angioscopy, and various others, the physical 
backgroimd that would produce the imaging intensity is of course different. Item 24 
symbolizes an image processing device that may execute various types of image 
enhancement operations or other processing. Next, the image is processed in data processing 
25 device 26, thereby resulting in the 3D-image-point-related-data set that may be used 
subsequently for providing the user with an appropriate viewing region. These data are 
transiently stored in storage device 30, and accessed therein for causing a display on display 
screen 28. Through an appropriate user interface, such as exemplified by keyboard 32, and 
generally enhanced by mouse-type or other features not shown for clarity, a user person may 
30 select various image positions or directions for associating thereto a clipping plane. This 
selecting will be retrocoupled to device 26 for thereupon amending the display in that all 
image points representing either a region that is nearer to the viewer than the region of 
interest, or rather representing a region that is farther away fi-om a viewer than the region of 
interest, are suppressed from being rendered on a display screen. If necessary, the process of 
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selecting the clipping planes may continue, either in a trial and error procedure by hand, or 
according to a prespecified and computer-controlled policy. If applicable, a particular imaged 
structure so found may be stored in memory as is for repetitive usage. 

Figures 2a-2d illustrate the principle of the various "thick-layer mode" 
5 functions. First in Figure 2a, a reconstruction volume in the shape of an object cube is 

illustrated as being described by one of its principal diagonals AA' . The central point of the 
volume is the so-called stereo-cursor B at the intersection point of the four principal 
diagonals of the cube. Now, the axis of a rotation over 1 80° during the acquisition of 
information for allowing to image the space identified by the Figure may be vertical in world 
10 space, and also vertical through the stereo cursor point B. Now, a first clipping plane may be 
Q shifted parallel from point A to point C as shown. Furthermore, a second clipping plane may 

\ ^ be shifted parallel to the first clipping plane from point A to point C as shown. Within the 

cube described by principal diagonal AA', a thinner block or slab is now defined by its 
C| principal diagonal CC It has been foimd that much medical information may be acquired by 

f 15 restricting the imaging to the intermediate region between the two clipping planes. A 
m differential shifting between the two clipping planes would allow to have a thick slab of 

C variable size. Of course, a further particular type of manipulating of the thick slab would be 

C5 the parallel shifting of the two clipping planes together. In certain situations, the two 

clipping planes need not be completely parallel. The amount of deviation from parallelism is 
20 may be suggested by the shapes of any interfering structures in the object A deviation of less 
than 25'' is expected to give only a slight deterioration in essence whilst allowing to ignore 
various types of interfering structures. In some situations a deviation of somewhat less than 
60*^ could even be advantageous. These procedures could then be accompanied by shifting as 
well as by rotating of the clipping plane or planes. 
25 Figure 2b by way of example to parallel clipping planes and illustrates the 

combination of introducing the two clipping planes according to the present invention as 
being combined with the rotating of the thick slab aroimd an arbitrary axis. In the Figure, this 
rotation may be described as a first rotation around the line-of-sight through the video cursor 
B, combined with a second rotation around a horizontal line through the video cursor B. Of 
30 course, further rotations are feasible, such as around a vertical line through the video cursor 
B. In principle, any rotational position would be attainable. Through each such rotation, the 
thick slab is still being described by its principal diagonal DD'. The rotations may have 
arbitrary axis and angle. Of course, the rotation may be used in combination with the 
differential and parallel types of shift recited supra. 
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Figure 2c illustrates the combination of tiie rotations introduced in Figure 2b 
with a movement in three-dimensional space of the stereo cursor from position B to position 
F. In this manner. Figures 2a-2c describe all possible reconfigurationing of the unaging thick 
slab. In a similar manner, the nearer and farther planes need not be fully parallel. Such could 
be advisable if the configurations of wanted versus unwanted points would not match a flat 
slab, but rather one that had a varying thickness along its extension. 

Figure 2d proposes a configuration for attaining a stereoscopic view of the 
object in combination with the thick slab approach. In fact, the Figure represents a view of 
Figure 2a' s cube as seen from above. There are now two slabs 44 and 46 of identical 
thicknesses and coinciding stereo cursor, but differential rotations, such as over an angle of a 
few degrees in the range of 0-6°. Now, the normal lines (40, 42) to the surfaces have become 
dilatated, so that the combined slabs will allow stereotactic viewing through the use of an 
appropriate stereo goggle, each eyeglass pertaining to a respective slab. By itself, such 
goggles have been in wide use, such as for viewing pseudo-stereo movie pictures. 

Figures 3a-3b illustrate the building of a "tomosynthesis thick layer" through 
superposing a plurality of successive "thin layers". By itself, persons of ordinary skill in the 
art of medical imaging will recognize the technology of tomosynthesis, and reference is had 
in this respect to standard University Textbooks. As shown in Figure 3a, standard application 
of such technology to a spatial object cube 48 similar to that of Figure 2a will allow to get 
accurate visual information on points within a thin slab or pseudo-plane 50; the sharpness of 
such point informations will however quickly diminish for points a bit outside pseudo-plane 
50. Figure 3b illustrates the effect of repeating the same measurements while stepping or 
shifting this pseudo-plane along staggered positions 52, 54, 56. Superposing the results so 
acquired for the respective pseudo-planes will allow to quite acceptably reconstruct the "thick 
slab" of Figure 2a, The front and rear pseudo-planes in this case will conceptually closely 
corresponding to the nearer and farher clipping planes, respectively. To attain this effect, the 
spacings of the positions 52-56 must be neither too large nor too small. If too small, the 
various pseudo planes will generate interference; if too large, relevant information on the 
regions between two pseudo-planes will tend to get lost. 

Figures 4a-4b illustrate the formation of a spatial spectroscopic image through 
the superposing of successive thin layers as introduced in Figure 3a. First, Figure 4a in the 
same manner and direction of view (i.e. again as seen from above) as Figure 2d proposes a 
rotation between the respective directions of view for the two pseudo-planes 58, 60, the latter 
in this manner constituting a so-called "stereo couple". Due to the fact that the information 
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relaxates away from the pseudo-plane, there still is quite a lot of useful information present 
mside pseudo-plane 60, especially so in the central region of tiie block. Next, these stereo 
couples are shifted in the same manner as in Figure 3b, in this elementary embodiment 
represented by the respective stereo couples 58/60, 62/66, and 64/68. The shifting is 
undertaken under maintaining of the orientations of the pseudo-planes. This flien has as a 
result that especially the central part of the block may be viewed in the same stereotactic 
manner as discussed with respect to Figure, 2d, but now being based on tomosynthesis and 
the inherent qualities and advantages offered by this sophisticated technology. Furthermore, 
the three manipulation functions of differential and parallel shifting and rotating as discussed 
with reference to Figures 2a, 2b may be applied here in similar manner, thereby effecting 
comparable perceptive and ergonomic advantages as the earlier embodiment 



